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(Autoregressive  Models  for  Stream  Discharge) 

Joan  Raup  Rosenblatt 

1,  Introduction 

This  report  is  supplementary  to  MBS  Report  6513  (July  1959)^ 
in  which  the  background  for  the  problem  and  a simple  probabilistic 
model  are  described.  The  model  stated  in  that  report  is  now 
modified  t©  incorporate  autocorrelations  in  the  time  series  of 
stream  discharges. 

In  this  study^  the  correlation  structure  for  a bivariate  time 
series  is  derived  from  an  autoregressive  model  (Section  2) , A 
given  correlation  structure  does  not^  however^  uniquely  determine 
a bivariate  autoregressive  scheme.  At  the  end  of  Section  2^  the 
results  are  given  of  a brief  study  of  possible  autoregressive 
schemes  consistent  with  the  correlation  structure  derived  from  the 
model  assumed  here.  This  may  give  some  insight  into  the  interpre- 
tation of  the  assumptions  and  their  applicability  in  hydrologic 
studies , 

The  main  results  of  this  investigation  describe  the  properties 
of  a procedure  for  estimating  the  mean  |i  of  the  distribution  of 
discharge  for  a stream  for  which  there  is  a "short  record’%  the 
estimation  procedure  making  use  of  the  correlation  between  the  dis- 
charge from  this  stream  and  the  discharge  from  a nearby  stream  for 
which  there  is  a "long  record".  Estimation  of  the  mean  discharge 
u is  discussed  in  Section  3,  Derivation  of  the  variance  formula 
is  outlined  in  an  appendix. 


2.  Autoregressive  Models  for  Stream  Discharge 
2.1  Derivation  ©f  Correlation  Structure 

It  is  assumed,  as  in  the  earlier  report,  that  the 
simultaneous  discharges  from  two  streams  at  time  t 

have  a joint  normal  distribution  with  parameters  |j,y,  ^y^j>P 


poj^/Oy 


Stream  discharge  is  assumed  to  be  stationary;  i.e,,  these 


parameters  (among  others)  are  the  same  for  any  t®"0,  - I,  -=2,  , 
Instead  of  assuming  independence  among  pairs  Y^) 

at  different  times,  it  is  assumed  that  each  of  the  two  discharge 
series  dependent,  with  autocorrelations 

arising  from  an  autoregressive  structure  of  the  form: 

+ U 


h - ^ 


■ "t  ^ 

p (f^  , » IX  ) + , 

*^y^  t“l  ^y  t ^ 

where  ^ sequence  of  bivariate  random  variables 

which  are  assumed  to  be  independent  and  identically  distributed 

with  joint  normal  distribution.  Also,  any  or  is 

independent  of  any  X,  or  Y.  (s>0)  . 

*C'“3  *C"3 

From  the  assumptions  about  the  joint  distribution  of 
(X^,  Y^) , it  follows  that  and  have  zero  means,  variances 
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a - p/)  a/ 

(1  - Py*)  Oy* 


and  correlation 
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In  order  that  the  above  formulas  make  sense ^ it  is  necessary  that 

s / 1 y-'  I It  n A r\  ^ X i„e 


Pv"  < 9 


2 
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< 1,  and  *0^0, 


P^a-p^Py)^  < (1-p/)  a-Py^) 


The  last  inequality  is  evidently  satisfied  if  p “ p ^ 

* y 


but 


places  some  restrictions  on  possible  values  of  p ^ p and  p when 

X y 


Pv  ^ P, 


We  now  calculate  the  lagged  correlations 
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This  completes  the  derivation  of  the  correlation 
structure  for  a sequence  of  pairs  "^t^  J 

One  further  specializing  assumption  will  be  made  in  the 


derivations  given  in  Section 
assumed  that 


That  is„  it  will  be 


^y 

This  greatly  simplifies  the  calculations. 

2.2.  Alternative  Autoregressive  Models 

It  was  remarked  in  the  introduction  that  the  autoregressive 
structure  assumed  above  is  not  the  only  one  which  might  lead  to 
this  set  of  correlations.  For  a brief  general  discussion  of  this 
question^  see  for  example  Quenouille  (1957) . 
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As  an  illustration^  the  bivariate  autoregressive  series 
generated  by  the  following  equations  would  have  the  same  correlation 
structure  ° 
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where  i,  ^ 6 are  a.ll  mutually  independent  normal  random 

^ X* 

variables  with  mean  zero  and  variance  unity. 

The  postulated  correlation  structure  would  also  be 


generated 

by 

the  following 

set  of 

equations  (with  the  same  assumptions 

about  € 
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The  point  of  these  examples  is  that  there  would  foe  many  ways  of 
writing  (U^  ^ ¥^)  as  linear  functions  of  ^ where 

i)  <5^  are  independent  and  ^ V^,  have  the  prescribed  variances 


-5^ 


and  covariance.  Unless  there  are  physical  reasons  for  postulating 
a particular  autoregressive  structure^  the  model  employed  here  has 
certain  ambiguities. 

3.  Estimation  ©f  the  Mean 

Suppose  that  X_^  denotes  discharge  from  the  stream 
with  long  record^  and  Y denotes  dischaxge  from  the  stream  with 
short  record.  The  data  given^  then_5,are 

(X  , Y (X  , ¥ ) , 

and 

X ....oo.X  o 

Ui  + 1 ^ ^2 


Let  N ® denote  the  number  of  time  periods  covered  by 

the  long  record. 


Estimation  of  the  mean  diseharg'e  p,  for  the  stream 
with  a short  record  is  assumed  (as  in  the  earlier  report)  to 
employ  the  ^'synthetic”  values 
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Bi  + H2  ^ 


obtained  from  the  estimated  regression  of  on  . Thus^ 


the  estimation  for  u is 


where 


U - Y.  + ^ b(X 
1 JN 
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and 


n. 
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b 


Z (X.  ™ X,)  (¥,  ■==  YJ/  Z (X.  ” X . 

i-1  ^ 1 1 1 

The  estimator  U is  an  unbiased  estimator  for  \i  | 

V 


that  is 


EU 


IXy  , 


where  E denotes  mathematical  expectation. 

An  approximate  formula  for  the  variance  of  U ^ in- 


cluding terms  up  to  order  is 

r.  2 ~~ 


Var  U = 
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i+ir  2'r 
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This  is  written  in  a form  which  maices  it  evident  that^  for  "T  = 0^ 
this  formula  agrees  with  the  formula  derived  by  H,  A„  Thomas  (up  to 
the  same  order  of  approximation) , 
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Appendix 


The  basic  approach  to  the  derivation  of  Var  U is  given^ 
together  with  the  matrix  notation  employed.,  The  derivation  itself 
is  sketched_5,  with  lengthy  calculations  suppressed, 

A ■=  1 , Transformation  into  a representation  in  terms  of 
mutually  independent  random  variables. 

For  t = 2^  3^  , „ „ 5 we  have  the  autoregressive  relations 

^ h ’ 

- Hy)  4.  , 

where  the  (U^  ^ V^)  are  mutually  independent  bivariate  random 
variables  with  zero  means^  Variances 

aj  - (1  ^ - (1  -'tra)  q2  ^ 

and  correlation  p = p, 

^uv  ^ 

Now  let 

- (X^  ^ ^1  ^ ^^1  " ^^y^^^y  ^ 

and^  for  t > 2^ 

- ®t  / °x  » 'll  = h / °y  v'l  - • 

By  repeated  use  of  the  autoregressive  equations^  we  derive  the 
transformation 


- " '’x  h ’ 
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*^X  X 


s/T’TW  ^ 
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t > 2, 


Py  = a 


y ^ 


cj„  T,^  + \h  - 0 

3-2 


y 


y 


t > 2, 


8- 


through  which  the  X,^  and  are  expressed  in  terms  of  independent 
bivariate  random  variables  ^ t)^)  having  joint  normal  distribution 

with  zero  means^  unit  variances^  and  correlation  p» 

V/e  now  make  the  further  transformation 

“ p + nA  “ p^  0^  , t - 1,  2^  , „ . ^ n^  ^ 

where  the  are  normal  with  zero  means  and  unit  variances and 
the  0,  and  4,.  are  all  mutually  independent. 


A-2 , Matrix  notation  and  some  preliminary  remarks <, 

The  derivations  are  most  efficiently  conducted  in  matrix 
notation.  This  section  assembles  all  the  def init ions  of  notation, 

~ identity  matrix  of  order  m 

e “ column  vector  of  ra  ones 
m 

“ matrix  of  order  m all  of  whose  elements  are  equal 
to  one 

"^mn“  ^ rectangular  matrix  of  ones 


A’  ~ transpose  of  the  matrix  A 

tr  A trace  of  the  (square)  matrix  A^  i,e,^  the  sum  of  the 
elements  on  the  diagonal. 

Extensive  use  is  made  of  the  fact  that  tr  (AB)  = tr(BA);, 
whenever  the  products  AB  and  BA  are  both  possible.  In  particular^ 
any  quadratic  form  x’  Ax  may  be  written  tr (A  x x"). 

We  now  introduce  the  matrix  notation  for  the  random 
variables  ^ ^ and  for  the  transformations  given  in  the  pre- 

ceding section.  Let 
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(X,  , 
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(X, 


n^+  1^ 
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each  being  a column  vector.  The  transformation  may  be  written 
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h 
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" ^"y  % " °y  '^'1  ’ 

where  (at  the  risk  of  minor  confusion)^ 

, ...  , )'  , 
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Also^  

ni  = P . 

with 

^ ° ^ ®ii  ^ ' ” 

Now^  define 

s - Y,  • 

i=l 

In  the  matrix  notation^  this  becomes 
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” J ) X 
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1 
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(n,  I 

1 

JnP  ‘^11  ' 


and  it  will  be  convenient  to  define 


T = ‘^ll’  ("l  Gil  ’ 


SO  that 


S = T 


Now  the  estimated  regression  coefficient  may  be  written  (recalling 
^ = P ay/a,,)  , 
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X y 
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o o 
X y 
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= p + \/i  - p2  1^'  T . 

Finally^  the  estimator  for  |i  may  be  written 

U - bCXg  X^) 

1^0  ^ 

~ (b  — 3)  (Xg  ~ 

To  verify  that  SU  ==  we  observe  that  E ^ and 

E(X2  ~ X^)  = 0,  Also^  it  has  been  established  above  that  (b  « p) 

is  a linear  function  of  the  ^ which  are  independent  of  the  | 

and  (X2  - X^)  is  a linear  function  of  the  , Hence 

E(b  -=  p)  (Xg  » X^)  - 0„ 


A-3o  Derivation  of  the  variance  of  U, 


The  derivation  involves  some  lengthy  calculations^  which 
will  not  be  given  in  full.  Referring  to  the  expression  for  U given 
at  the  end  of  the  preceding  section^  we  Vi?rite 
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+ 2 (b  « p)  (X2  " X^)  (Y^  - p ) 
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(b  ™ p)2  (x^  ™ X^)^  + 
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p(b-p)  (X2"X;j^) 
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The  last  of  the  six  terms  in  the  expression  above  is  a linear 
function  of  the  0^  which  enter  only  in  (b  - and  hence  has  expected 

value  zero.  The  expected  values  of  the  first  three  terms  are 
easily  obtained^  and  are 
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If  we  write 
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11 
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21 


G. 


22 


then^  after  some  rearranging^  the  sura  of  the  three  terms  given 
above  iss 
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e»j^  G G'  e^^  + (l»p2) 
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Next^  consider  the  fourth  and  fifth  terms  in  the 
expression  for  (U  - These  involve  S and  in  their 

denominators^  and  their  expected  values  will  be  evaluated  approxi- 
mately. Firsts  however^  observe  that  the  vectors  6^  and  ^2  appea^^ 
only  in  the  numerators.  Holding  the  vector  fixed,  and  taking 
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expectations  with  respect  to  the  random  variables  in  9^  and  , 
the  calculations  for  the  fourth  and  fifth  terms  are  reduced  to 
the  followings 
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There  are  six  terms  to  be  evaluated  here^  each  involving 
a ratio  of  random  variables.  For  a first-order  approximation^ 
each  random  variable  is  replaced  by  its  expected  value.  Further 
approximation  involves  deletion  of  certain  terms  having  the  factor 
(or  <,  which  is  assumed  to  be  negligible.  Finally^  only 

terms  of  order  up  to  1/n^^  are  retained. 

Evaluation  of  the  first  term  will  be  sketched^  and  the 
values  of  the  other  five  terms  will  be  listed.  For  the  first  term^, 
we  require  . 
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Now 
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ll') 


~13~ 


but  we  can  write  J = e e'  „ whence 

n T n T n , 

1 11 


tr  T = n,  tr  G, , G, , 
1 1111 


n,  11  11  n, 

i 1^ 


Now  it  is  easily  verified  that 
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Thus  the  trace  of  this  matrix  is  and  the  sum  of  all  the  elements 
of  this  matrix  is 
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1 1-=^ 


n. 


(1  » 1) 


n. 


Finally,  then,  deleting  the  negligible  terra  in  ^ 


E S = 


1 1 

Next,  in  a similar  way,  we  obtain 
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n^  ''11  ''11  ''n^ 


n^^  11  21 


after  deletion  of  terras  involving  tfl  and  1^2  , 

The  ratio  of  these  two  expected  values  is  of  order 
1/n^  , and  this  ratio  enters  a term  which  is  already  of  order 
l/n^2  (actually  l/n^ng)!  hence  this  term  will  not  appear  in  the 
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first-order  approximation. 

The  second  term  and  also  the  last  two  terms  turn  out 
similarly  to  make  no  contribution  to  an  approximation  up  to  order 

l/n^2  ^ 

For  the  third  term^  we  require  terms  up  to  order  1/n^^ 
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1+t^ 
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1+tr 
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n^"^  + 0(n^2) 

1+t^ 
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For  the  fourth  term^ 


we  have  similarlyi 


1+t^  1 


Assembling  all  these  terms  together  with  the  terms 
evaluated  previously  without  approximations^  we  obtain  the  variance 
formula  given  in  Section  3 of  this  report. 
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